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This application is submitted in the name of inventors Douglas Gourlay and James 
Aviani, both assignors to Cisco Technology, Inc., a California Corporation. 

5 SPECIFICAIION 

PHASED LEARNING APPROACH TO DETERMINING CLOSEST CONTENT 

SERVING SITES 

10 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to the field of network communications. More 

specifically, the present invention relates to the use of a phased learning approach to 

J:15 determine the closest content serving site to a user or server. 

The Background 

In a distributed computer network, content sites may be distributed throughout a 
network, each site containing identical content to at least one of the other distributed 
sites. This allows for both load balancing among multiple sites as well as for faster 
connections as users may connect to a server which is closest (in terms of transit time) to 
their own computer. 

This design has gained acceptance on the Intemet, where it is routine for large 
25 content distributors to maintain multiple servering locations throughout the Internet. 
When one server is busy, traffic may merely be directed to a different server. Likewise, 
if one server is down for repairs, traffic may merely be directed to a different server. 
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Finally, and perhaps most importantly, when multiple servers are available, the traffic 
may merely be directed to the server that is closest to the user. 

When a user requests content that is located on multiple distributed servers, the 
5 server having the lowest round-trip response time to the user's DNS Server must be 
determined. FIG. 1 is a block diagram illustrating a situation where a user requests 
content located on multiple distributed servers, PC 2 may be attempting to access content 
at "www.example.com". Thus, it first requests Domain Naming System (DNS) 
^ resolution from Client DNS Server 4. Then CUent DNS Server 4 queries the root DNS to 
ffiO determine the authoritative DNS server for example.com. 

J.' The Client DNS Server 4 may then query the authoritative DNS server for the 

□ domain www.example.com, which retums an NS record for www.example.com. The 
W Client DNS server 4 may then query the global server load balancer 6 for the 
gl5 "www.example.com" domain. At the global server load balancer 6, the various servers 
8a, 8b, 8c containing the content are known. The global server load balancer 6 then may 
query each of the servers 8a, 8b, 8c. The sites then respond by each sending a TCP/IP 
syn/ack packet to the cUent DNS server 4. The client DNS server 4 then receives the 
TCP/IP syn/ack packet and sends a reset (RST) packet back to each server 8a, 8b, 8c, 
20 resetting the syn/ack. This flows from the Client DNS server 4 to each server 8a, 8b, 8c 
directly. 
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When the servers 8a, 8b, 8c each receive the RST packet back, they may compute 
their respective transit times (by using the difference betu^een the time they originally 
sent the syn/ack packet and the time they received the RST packet back). This 
information may then be passed to the global server load balancer 6. The global server 
5 load balancer may then compare the transit times of all of the servers 8a, 8b, 8c, 
determine which is the lowest, and inform the cUent DNS server 4 of the resolved IP 
address of the lowest timed site. The cUent DNS server 4 may create a record to the PC 
containing the information indicating the server with the lowest transit time, at which 
point the PC may connect to the IP address for that server to retrieve the content. 

10 

This can be a fairly time consuming process, especially when the number of 
servers hosting the content grows larger. The relative lack of speed of the process may 
be bearable when there are only 3 servers hosting the content, but when there are 3000, 
the delays while waiting for servers to respond can be costly. Thus, what is needed is a 
15 solution that directs a user to the appropriate server in the least amount of time, especially 
as the number of servers grows large. 
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SUMMARY OF THE INVENTION 
In order to direct content requests to an appropriate content serving site in a 
computer network, a phased learning approach is utilized to ensure that, as best as 
possible, the request is made to content serving site with the shortest delay. In a setup 

5 phase, an indirect path return geographic sever load balancer times queries to all of the 
individual content serving sites so that the queries all arrive at the content serving sites at 
the same time. Therefore, when the requesting fixed location receives communications 
from the content serving sites, it can easily tell which content serving site has the least 
delay by an established race condition. The winner of the race may then be relayed to the 

10 indirect path retum geographic server load balancer for later usage. In an execution 
mode, only the m fastest content serving sites and n other sites (used to test random and 
new sites) are queried when a DNS request arrives from the requesting fixed location. 
The particular m fastest content serving sites and n other sites may be dynamically 
updated so as to ensure the most rehable directing of requests. This solution provides a 

15 very efficient and effective means by which to determine closest content serving sites 
while keeping load balancer-created traffic at a minimum. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram illustrating a situation where a user requests content 
located on multiple distributed servers. 

5 FIG. 2 is a block diagram illustrating a system utilizing indirect path retum 

geographic server load balancing technology in accordance with a specific preferred 
embodiment of the present invention. 

FIG. 3 is a flow diagram illustrating a method for using a phased learning 
10 approach for determining the closest content serving sites to a fixed location in a 

computer network in accordance with a specific embodiment of the present invention. 

FIG. 4 is a block diagram illustrating an apparatus for using a phased leaming 
approach for determining the closest content serving sites to a fixed location in a 
15 computer network in accordance with a specific embodiment of the present invention. 



5 



CISCO-2357 



DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

In the following description, a preferred embodiment of the invention is described 
with regard to preferred process steps and data structures. However, those skilled in the 
5 art will recognize, after perusal of this appHcation, that embodiments of the invention 
may be implemented using at least one general purpose computer operating under 
program control and/or using a program storage device, and that modification of the 
general purpose computer to implement the components, process steps, and/or data 
structures described herein would not require undue invention. 

10 

In accordance with a specific embodiment of the present invention, the 
components, process steps, and/or data structures are implemented using software. This 
implementation is not intended to be limiting in any way. Different implementations may 
be used and may include other types of operating systems, computing platforms, and/or 
15 computer programs. In addition, those of ordinary skill in the art will readily recognize 
that devices of a less general purpose nature, such as hardwired devices, devices relying 
on FPGA (field programmable gate array) or ASIC (application specific integrated 
circuit) technology, or the like, may also be used without departing from the scope and 
spirit of the inventive concepts disclosed herewith. 

20 
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The present invention utilizes a phased learning approach along with indirect path 
return geographic server load balancing technology in order to quickly and efficiently 
provide a user with a list of the fastest servers hosting the requested content. 



5 FIG. 2 is a block diagram illustrating a system utilizing indirect path return 

geographic server load balancing technology in accordance with a specific embodiment 
of the present invention. PC 50 attempts to access content at "www.example.com". 
Thus, it first requests Domain Naming System (DNS) resolution from Ghent DNS Server 
_ 52. Then Ghent DNS Server 52 queries the root DNS to determine the authoritative DNS 
mlO Server for the requested domain. The Ghent DNS Server 52 may then query the 
rU authoritative DNS server for the domain "www.example.com". The Ghent DNS server 
■zl 52 may then query the indirect path retum geographic server load balancer 54 for the 

"www.example.com" domain. At the indirect path retum geographic server load balancer 
yj 54, the various servers 56a, 56b, 56c containing the content are known. Additionally, the 
□15 time it takes to send a packet from the indirect path retum geographic server load 

balancer 54 to each of the various servers 56a, 56b, 56c is also known. This may be 
determined by pinging each of the servers and measuring the response times (the time it 
takes to receive a response back). Pinging may be done at regular intervals, to have on 
hand the most up-to-date information as to the response times of the various servers 56a, 
20 56b, 56c. 
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With the knowledge of the response times of each server 56a, 56b, 56c, the 
indirect path return geographic server load balancer 54 may then precisely time queries to 
each of the servers 56a, 56b, 56c so that the queries are received at each of the servers 
56a, 56b, 56c at exactly the same time. Thus if pinging determines that the response time 

5 for the servers 56a, 56b, and 56c are 100ms, 20ms, and 50ms, respectively, then the 
indirect path return geographic server load balancer 54 will first send a query to server 
56a, then wait 25ms and send a query to server 56c (the difference in the response times 
between server 56a and 56c divided by 2 because the query is only traveling one-way), 
then wait another 15ms and send a query to server 56b (difference in the response times 

10 between server 56a and 56b is 80ms, divided by 2 gives 40ms from the time the query to 
server 56a was sent). This ensures that the queries arrive at each of the servers 56a, 56b, 
and 56c at the same time. 



Since the queries arrive at each of the servers 56a, 56b, 56c at the same time, the 
15 DNS responses from 56a, 56b, 56c to the client DNS server 52 may be sent at the same 
time. This creates what may be called a one-way race condition. In order to determine 
the server 56a, 56b, 56c with the fastest transit time, the client DNS server 52 need only 
determine the server from which the first DNS Response packet it receives came. When 
a server 56a, 56b, or 56c wins the race it is known to the server by the corresponding 
20 HTTP Request coming in from an IP address with similarity to the Client-DNS server. 
The winning of the one-way race triggers an update to the indirect path geographic server 
load balancer with the client DNS servers IP address and the transit time for the race to 
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occur. The indirect path geographic server load balancer then adds this to an entry in its 
content routing table where it keeps the client-DNS server IP address mapped to the m 
fastest sites that responded to it. 



5 One problem, however, with this solution occurs when a large number of servers 

are placed in the system. The indirect path return geographic server load balancer 54 
must send requests to many or all of them, thus creating traffic that may actually interfere 
with the efficiency of the system, especially the client-DNS server. So while the time it 
takes to determine which is the fastest server when a user wishes to access content is 

10 greatly decreased, the overall speed of the servers may actually be slower. 



In order to remedy this concem, only a certain number of servers will be "active" 
at any one time for each client-DNS server, treated as independent entities. "Active" 
means that the server is subject to receive a query from the indirect path retum 
15 geographic server load balancer 54 for a particular client DNS server. In a specific 
embodiment of the present invention, 5 servers will be active at any one time for each 
client DNS server, although there can be overlap between different client DNS servers. 
The 5 servers will made up of the 3 servers having the lowest response time to the client- 
DNS server as well as 2 other servers used for testing (which will be described below). 

20 

Determining which servers are active will be performed using a phased learning 
approach. When the indirect path retum geographic server load balancer 54 is first 
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connected to the network or the network is otherwise "set up", the system is deemed to be 
in the setup phase. During the setup phase, all of the servers are sequentially tested as 
traffic comes in from different client-DNS IP addresses. All of the servers are pinged 
from the indirect path geographic server load balancer to determine their relative distance 

5 from the indirect path return geographic server load balancer. This data is stored in 
records at the indirect path retum geographic server load balancer 54, each record 
comprising the halved ping time from a content server to the indirect path retum 
geographic server load balancer. As the indirect path retum geographic server load 
balancer receives the first request from a client-DNS server, it randomly selects 10 

10 content servers to forward the equalized request to. These 10 servers respond back to the 
client DNS server establishing a race. The winner of this race is reported back to the 
indirect path retum geographic server load balancer by the content server. The indirect 
path retum geographic server load balancer 54 then adds a record to its table with the 
winning content server as an entry under the client DNS servers IP address with the 

15 transit time for it to respond and receive traffic. If space is a concem, then the number of 
records may be limited such as storing only the 3 fastest content servers and simply 
replacing a record corresponding to a particular content server if a faster server is found. 

After the system has been set up, it still may be necessary to adjust which servers 
20 are active based on changes that occur within the network. Typical changes include high 
traffic to a particular server and addition or deletion of a server from the network. When 
the system is not in the setup phase, it is in the execution phase. During the execution 
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phase, the 3 fastest servers are active at all times for each client-DNS server. The two 
extra slots are used for testing random servers in a stable network (no servers added or 
deleted). If one of the random servers tested winds up having a lower transit time than 
one of the three fastest servers, then it will supplant the slowest of the three fastest 
5 servers. If a new server is added to the system, it will be immediately added to one of 
the two extra slots so it can be tested until has become one of the fastest servers mapped 
to a client-DNS server. Just like with the random servers, if the new server tests out with 
a lower transit time than one of the three fastest servers, then it will supplant the slowest 
of the three fastest servers. 

|lO 

ry It should be noted that it is not necessary that the number of active servers be 5. 

5; Any number will work, and the number may have to be varied for different appUcations 
in different systems. Additionally, the number of extra slots to use may also be varied. 

015 Furthermore, it may be advantageous at times to make the number of active 

servers dynamic. If there is a high rate of change in the list of fastest servers, it indicates 
that the network may not be stable. This may be used as an indicator to a system 
administrator that action needs to be taken to examine the root of the instability in the 
system. During this instability, it may be preferable to increase the number of servers in 
20 the hst of fastest servers so the rate of change can be mitigated as the available pool of 
servers to be tested for each iteration is increased. The number may be scaled back down 
when stability returns to the system. 
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FIG. 3 is a flow diagram illustrating a method for using a phased learning 
approach for determining the closest content serving sites to a fixed location in a 
computer network in accordance with a specific embodiment of the present invention. 
5 This method may be performed by an indirect path return geographic server load 
balancer. 



The system begins in a setup phase, when the computer network (or a portion 
thereof) is first setup. However, setup mode may also be entered into whenever an 
10 administrator wishes to test the network. Thus, if a new version of the indirect path 

return geographic server load balancer or the table has been erased, the administrator may 
wish to enter setup mode even though it is not the first time the network is setup. 



The fixed location will generally be a PC and client DNS server combination. 

15 However, as the computer network grows more complex, there may be a need to serve 
content to other devices, such as gateways, routers, etc. Thus the term "fixed location" 
should not be limited to PCs and client DNS servers. At 100, a DNS request is received 
from the fixed location. Even though the system is in the setup phase, there still needs to 
be a fixed location defined for testing purposes. At 102, a response time is determined 

20 for each of the content serving sites. This is determined by pinging each of the content 
serving sites and then measuring the time it takes to receive a reply back from each of the 
content serving sites. That time is the response time for each content serving site. 



12 



CISCO-2357 



At 104, queries are sent to each of the content serving sites, timing the queries so 
that they arrive at each of the content serving sites at the same time by using said 
response time for each of the content serving sites. This is accompHshed by querying the 
content serving sites in order of their response times, longest response time first. The 
query for a particular content serving site is delayed from the query for the content 
serving site with the longest response time for a time equal to one half of the particular 
content serving site's response time. 

At 106, data is received from the fixed location as to the transit times of each of 
the content serving sites. The fixed location would have measured these transit times by 
tracking when a response from each of the content serving sites was received (the 
response from each of the content serving sites being generated upon receipt of the query 
from the indirect path retum geographic server load balancer). The data may be in a form 
of a record hsting the IP address of fixed location, the transit time from a particular 
content serving site, and the IP address of that particular content serving site. At 108, the 
data may then be stored in table for later use. 

When the network is operating normally, the system may be in the execution 
phase. At 1 10, a DNS request is received from the fixed location. At 1 12, a response 
time is determined for each of n fastest content serving sites and m other content serving 
sites, said n fastest content serving sites chosen by using said data and choosing the n 
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content serving sites witii the lowest transit times, said m other content serving sites 
chosen by selecting new content serving sites as well as randomly selecting old content 
serving sites. Thus, whenever a new content serving site is added to the network it will 
become one of the m other content serving sites until it has been tested once. 
5 Determining the response time is accompUshed by pinging each of the n fastest content 
serving sites and m other content serving sites and then measuring the time it takes to 
receive a reply back from each of the n fastest content serving sites and m other content 
serving sites. That time is the response time for each of n fastest content serving site and 

^ m other content serving sites. 

SlO 

RJ At 1 14, queries are sent to each of n fastest content serving sites and m other 

Ji; content serving sites, timing the queries so that they arrive at each of the n fastest content 

serving sites and m other content serving sites at the same time by using said response 
yj time for each of the n fastest content serving sites and m other content serving sites. This 
Ol5 is accomplished by querying the n fastest content serving sites and m other content 

serving sites in order of their response times, longest response time first. The query for a 
particular n fastest content serving sites or m other content serving sites is delayed from 
the query for the n fastest content serving sites or m other content serving sites with the 
longest response time for a time equal to one half of the particular content serving site's 
20 response time. 
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At 1 16, data is received from the fixed location as to the transit times of each of 
the n fastest content serving sites and m other content serving sites. The fixed location 
would have measured these transit times by tracking when a response from each of the n 
fastest content serving sites and m other content serving sites was received (the response 
5 from the n fastest content serving sites and m other content serving sites being generated 
upon receipt of the query from the indirect path return geographic server load balancer). 
The data may be in a form of a record listing the IP address of fixed location, the transit 
time from a particular content serving site, and the IP address of that particular content 
serving site. At 1 18, the data may then be stored in table for later use. 

|lO 

ry In a specific embodiment of the present invention, n is 3 and m is 2. However, as 

discussed earlier, in some situations it is preferable to have these numbers be dynamic. 

iy FIG. 4 is a block diagram illustrating an apparatus for using a phased learning 

Ol5 approach for determining the closest content serving sites to a fixed location in a 

computer network in accordance with a specific embodiment of the present invention. 
An indirect path retum geographic server load balancer. 150 may be located in a network 
with content serving sites 152a, 152b, 152c, 152d and a fixed location 154. 

20 The system begins in the setup phase, when the computer network (or a portion 

thereof) is first setup. However, setup mode may also be entered into whenever an 
administrator wishes to test the network. Thus, if a new version of the indirect path 
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return geographic server load balancer or the table has been erased, the administrator may 
wish to enter setup mode even though it is not the first time the network is setup. 

The fixed location will generally be a PC and client DNS server combination. 
However, as the computer network grows more complex, there may be a need to serve 
content to other devices, such as gateways, routers, etc. Thus the term "fixed location" 
should not be hmited to PCs and cUent DNS servers. A DNS request receiver 156 
coupled to the fixed location 154 receives a DNS request from the fixed location 154. 
Even though the system is in the setup phase, there still needs to be a fixed location 
defined for testing purposes. A response time determiner 158 coupled to said DNS 
request receiver 156 and to the content serving sites 152a, 152b, 152c, 152d determines a 
response time for each of the content serving sites 152a, 152b, 152c, 152d. This is 
determined by using a pinger 160 to ping each of the content serving sites 152a, 152b, 
152c, 152d and then measuring the time it takes to receive a reply back at a response time 
receiver 162 from each of the content serving sites. That time is the response time for 
each content serving site. 

A query sender 164 coupled to said response timer determiner 162 and to the 
content serving sites 152a, 152b, 152c, 152d sends queries to each of the content serving 
sites 152a, 152b, 152c, 152d, timing the queries so that they arrive at each of the content 
serving sites at the same time by using said response time for each of the content serving 
sites. This is accomplished by ordering the content serving sites in order of their 
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response times, longest response time first, using a response timer orderer 166, and then 
timing the queries with a query timer 168. The query for a particular content serving site 
is delayed from the query for the content serving site with the longest response time for a 
time equal to one half of the particular content serving site's response time. 

5 

A data receiver 170 coupled to the fixed location 154 receives data from the fixed 
location 154 as to the transit times of each of the content serving sites. The fixed location 
154 would have measured these transit times by tracking when a response from each of 
the content serving sites 152a, 152b, 152c, 152d was received (the response from each of 

10 the content serving sites 152a, 152b, 152c, 152d being generated upon receipt of the 
query from the indirect path retum geographic server load balancer 150). The data may 
be in a form of a record listing the IP address of fixed location, the transit time from a 
particular content serving site, and the IP address of that particular content serving site. 
A data storer 172 coupled to said data receiver 170 and to a memory 174 may store the 

15 data in a table in memory 174 for later use. 

When the network is operating normally, the system may be in the execution 
phase. In order to distinguish between the two phases, a phase determiner 176 coupled to 
said response time determiner 158, said query sender 164, and said data receiver 170, is 
20 provided. In the execution phase, the DNS request receiver 156 receives a DNS request 
from the fixed location 154. The response time determiner 158 may then determine a 
response time for each of n fastest content serving sites and m other content serving sites. 
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said n fastest content serving sites chosen by using said data and choosing the n content 
serving sites with the lowest transit times, said m other content serving sites chosen by 
selecting new content serving sites as well as randomly selecting old content serving 
sites. This choosing of the fastest content serving sites may be accomplished by using an 
n fastest content serving site chooser 178, which may access the memory 174 to aid in its 
determination. Additionally, an m other content serving site chooser 180 may be 
provided to choose which new/random sites to have active. Thus, whenever a new 
content serving site is added to the network it will become one of the m other content 
serving sites until it has been tested once. 

Determining the response time is accompHshed by pinging each of the n fastest 
content serving sites and m other content serving sites using the pinger 160 and then 
measuring the time it takes to receive a reply back at said response timer receiver 162 
from each of the n fastest content serving sites and m other content serving sites. That 
time is the response time for each of n fastest content serving site and m other content 
serving sites. 

The query sender 164 sends queries to each of n fastest content serving sites and m 
other content serving sites, timing the queries so that they arrive at each of the n fastest 
content serving sites and m other content serving sites at the same time by using said 
response time for each of the n fastest content serving sites and m other content serving 
sites. This is accomplished by querying the n fastest content serving sites and m other 
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content serving sites in order of their response times, longest response time first, using 
said response time orderer. The query for a particular n fastest content serving sites or m 
other content serving sites is delayed from the query for the n fastest content serving sites 
or m other content serving sites with the longest response time for a time equal to one 
5 half of the particular content serving site's response time. 

The data receiver 170 receives data from the fixed location 154 as to the transit 
times of each of the n fastest content serving sites and m other content serving sites. The 
fixed location 154 would have measured these transit times by tracking when a response 

10 from each of the n fastest content serving sites and m other content serving sites was 

received (the response from the n fastest content serving sites and m other content serving 
sites being generated upon receipt of the query from the indirect path retum geographic 
server load balancer). The data may be in a form of a record Usting the IP address of 
fixed location, the transit time from a particular content serving site, and the IP address of 

15 that particular content serving site. A data storer 172 coupled to said data receiver 170 
and to a memory 174 may store the data in a table in memory 174 for later use. 

In a specific embodiment of the present invention, /? is 3 and m is 2. However, as 
discussed earlier, in some situations it is preferable to have these numbers be dynamic. 

20 

While embodiments and applications of this invention have been shown and 
described, it would be apparent to those skilled in the art having the benefit of this 
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disclosure that many more modifications than mentioned above are possible without 
departing from the inventive concepts herein. The invention, therefore, is not to be 
restricted except in the spirit of the appended claims. 
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CLAIMS 

What is claimed is: 

^ A method for using a phased learning approach for determining the closest content 
serving sites to a fixed location in a computer network including: 
in a setup phase: 

storing data as to the transit times of each of the content serving sites in a 

table; 

in an execution phase: 

receiving a DNS request from said fixed location; 

determining a response time for each of n fastest content serving sites and 
m other content serving sites, said n fastest content serving sites chosen by using 
said data and choosing the n content serving sites with the lowest transit times, 
said m other content serving sites chosen by selecting new content serving sites as 
well as randomly selecting old content serving sites; 

sending queries to each of the n fastest content serving sites and m other 
content serving sites, timing said queries so that they arrive at each of the n fastest 
content serving sites and m other content serving sites at the same time by using 
said response time for each of the n fastest content serving sites and m other 
content serving sites; 
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receiving data from said fixed location as to the transit times of each of the 
n fastest content serving sites and m other content serving sites; and 
storing said data in said table. 

5 2. The method of claim 1, wherein said setup phase includes: 
receiving a DNS request from said fixed location; 
determining a response time for each of the content serving sites; 
sending queries to each of the content serving sites, timing said queries so that 
they arrive at each of the content serving sites at the same time by using said response 
10 time for each of the content serving sites; 

receiving data from said fixed location as to the transit times of each of the content 
serving sites; 

storing said data in a table; 

15 3. The method of claim 2, wherein said determining the response time for each of the 
content serving sites includes: 

pinging each of the content serving sites; 
receiving a reply from each of the content serving sites; and 
determining the response time for each of the content serving sites by computing 
20 the difference in time from said pinging to said receiving for each of the content serving 
sites. 
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4. The method of claim 1, wherein said determining the response time for each of n 
fastest content serving sites and m other content serving sites includes: 

pinging each of n fastest content serving sites and m other content serving sites; 

receiving a reply from each of n fastest content serving sites and m other content 
5 serving sites; and 

determining the response time for each of n fastest content serving sites and m 
other content serving sites by computing the difference in time from said pinging to said 
receiving for each of the each of said n fastest content serving sites and m other content 
serving sites. 

10 

5. The method of claim 1, wherein transit time is the time it takes a content serving 
site to send a packet to said original location after receiving a query. 



6. The method of claim 1, wherein said data includes at least one record, said record 
15 including a transit time, a network address for said fixed location, and a network address 
for a content serving site, said transit time being the transit time between said fixed 
location and said content serving site. 



7. The method of claim 2, wherein said sending queries to each of the content 
20 serving sites includes: 

querying each of the content serving sites in order of their response times, longest 
response time first, setting a delay for a query for a particular content serving site from 
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the time the query to the content serving site with the longest response time as one half of 
said particular content serving site's response time. 

8. The method of claim 1, wherein said sending queries to each of the n fastest 
5 content serving sites and m other content serving sites includes: 

querying each of said content serving sites n fastest content serving sites and m 
other content serving sites in order of their response times, longest response time first, 
setting a delay for a query for a particular content serving site from the time the query to 
said n fastest content serving site or m other content serving site with the longest response 
SO time as one half of said particular content serving site's response time. 

9. The method of claim 1, wherein n is 3 and m is 2, 

y 10. The method of claim 1 , wherein n may be varied based on stability of the 
Ol 5 computer network. 

1 1 . The method of claim 1, wherein n may be varied based on a rate of change of said 
content serving sites making up n content serving sites. 

20 12. The method of claim 1, wherein said setup phase occurs when the computer 
network is first set up. 
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13. The method of claim 1, wherein said execution phase occurs when the computer 
network is operating normally. 



14( An apparatus for using a phased learning approach for determining the closest 



5 content serving sites to a fixed location in a computer network including: 
a DNS request receiver coupled to the fixed location; 

a response time determiner coupled to said DNS request receiver and coupled to 
the content serving sites; 

a query sender coupled to said response time determiner and coupled to the 
1 0 content serving sites ; 



15 15. The apparatus of claim 14, wherein said response time determiner includes an n 
fastest content serving site chooser and an m other content serving site chooser. 

16. The apparatus of claim 14, wherein said query sender includes a query timer. 

20 17. The apparatus of claim 14, wherein said response time determiner includes a 
pinger and a reply receiver. 




a data receiver coupled to the fixed location; 



a memory coupled to said query sender; and 



a data storer coupled to said data receiver and coupled to said memory. 
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18. The apparatus of claim 14, wherein said query sender includes a response time 
orderer. 

19. The apparatus of claim 14, further including a phase determiner coupled to said 
5 response time determiner, said query sender, and said data receiver. 



A program storage device readable by a machine, tangibly embodying a program 
of instructions executable by the machine for using a phased learning approach for 
determining the closest content serving sites to a fixed location in a computer network, 
if 10 the method including: 




in a setup phase: 



storing data as to the transit times of each of the content serving sites in a 



table; 



in an execution phase: 



yi5 



receiving a DNS request from said fixed location; 



determining a response time for each of n fastest content serving sites and 



m other content serving sites, said n fastest content serving sites chosen by using 



said data and choosing the n content serving sites with the lowest transit times. 



said m other content serving sites chosen by selecting new content serving sites as 



20 



well as randomly selecting old content serving sites; 



sending queries to each of the n fastest content serving sites and m other 



content serving sites, timing said queries so that they arrive at each of the n fastest 
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content serving sites and m other content serving sites at the same time by using 
said response time for each of the n fastest content serving sites and m other 
content serving sites; 

receiving data from said fixed location as to the transit times of each of the 
n fastest content serving sites and m other content serving sites; and 

storing said data in said table. 



il . An apparatus for using a phased learning approach for determining the closest 
content serving sites to a fixed location in a computer network including: 

means for storing data as to the transit times of each of the content serving sites in 
a table in a setup phase; 

means for receiving a DNS request from said fixed location in an execution phase; 
means for determining a response time for each of n fastest content serving sites 
and m other content serving sites, said n fastest content serving sites chosen by using said 
data and choosing the n content serving sites with the lowest transit times, said m other 
content serving sites chosen by selecting new content serving sites as well as randomly 
selecting old content serving sites in an execution phase; 

means for sending queries to each of the n fastest content serving sites and m other 
content serving sites, timing said queries so that they arrive at each of the n fastest 
content serving sites and m other content serving sites at the same time by using said 
response time for each of the n fastest content serving sites and m other content serving 
sites in an execution phase; 
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means for receiving data from said fixed location as to the transit times of each of 
the n fastest content serving sites and m other content serving sites in an execution phase; 
and 

means for storing said data in said table in an execution phase. 

22. The apparatus of claim 21 , further including: 

means for receiving a DNS request from said fixed location; 

means for determining a response time for each of the content serving sites; 

means for sending queries to each of the content serving sites, timing said queries 
so that they arrive at each of the content serving sites at the same time by using said 
response time for each of the content serving sites; 

means for receiving data from said fixed location as to the transit times of each of 
the content serving sites; 

storing said data in a table; 

23 . The apparatus of claim 22, wherein said means for determining the response time 
for each of the content serving sites includes: 

means for pinging each of the content serving sites; 

means for receiving a reply from each of the content serving sites; and 

means for determining the response time for each of the content serving sites by 

computing the difference in time from said pinging to said receiving for each of the 

content serving sites. 
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24. The apparatus of claim 21, wherein said means for determining the response time 
for each of n fastest content serving sites and m other content serving sites includes: 
means for pinging each of n fastest content serving sites and m other content 
5 serving sites; 

means for receiving a reply from each of n fastest content serving sites and m 
other content serving sites; and 

means for determining the response time for each of n fastest content serving sites 
and m other content serving sites by computing the difference in time from said pinging 
5-10 to said receiving for each of the each of said n fastest content serving sites and m other 
n=j content serving sites. 

h 25 . The apparatus of claim 2 1 , wherein transit time is the time it takes a content 
W serving site to send a packet to said original location after receiving a query. 

26. The apparatus of claim 21 , wherein said data includes at least one record, said 
record including a transit time, a network address for said fixed location, and a network 
address for a content serving site, said transit time being the transit time between said 
fixed location and said content serving site. 

20 

27. The apparatus of claim 22, wherein said means for sending queries to each of the 
content serving sites includes: 
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means for querying each of the content serving sites in order of their response 
times, longest response time first, setting a delay for a query for a particular content 
serving site from the time the query to the content serving site with the longest response 
time as one half of said particular content serving site's response time. 

5 

28. The apparatus of claim 21 , wherein said means for sending queries to each of the n 
fastest content serving sites and m other content serving sites includes: 

means for querying each of said content serving sites n fastest content serving sites 
and m other content serving sites in order of their response times, longest response time 
rllO first, setting a delay for a query for a particular content serving site from the time the 
nj query to said n fastest content serving site or m other content serving site with the longest 
5 response time as one half of said particular content serving site's response time. 

y 29. The apparatus of claim 21, wherein n is 3 and m is 2. 

015 

30. Theapparatusof claim 21, wherein n may be varied based on stability of the 
computer network. 

3 1 . The apparatus of claim 21 , wherein n may be varied based on a rate of change of 
20 said content serving sites making up n content serving sites. 



30 



CISCO-2357 

32, The apparatus of claim 21, wherein said setup phase occurs when the computer 
network is first set up. 

33. The apparatus of claim 21, wherein said execution phase occurs when the 
computer network is operating normally. 
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ABSTRACT 

In order to direct content requests to an appropriate content serving site in a 
computer network, a phased learning approach is utilized to ensure that, as best as 
possible, the request is made to content serving site with the shortest delay. In a setup 
5 phase, an indirect path return geographic sever load balancer times queries to all of the 
individual content serving sites so that the queries all arrive at the content serving sites at 
the same time. Therefore, when the requesting fixed location receives communications 
from the content serving sites, it can easily tell which content serving site has the least 
delay by an estabhshed race condition. The winner of the race may then be relayed to the 
flo indirect path return geographic server load balancer for later usage. In an execution 
rU mode, only the m fastest content serving sites and n other sites (used to test random and 
5 new sites) are queried when a DNS request arrives from the requesting fixed location. 
□ The particular m fastest content serving sites and n other sites may be dynamically 
y updated so as to ensure the most reliable directing of requests. This solution provides a 
yi5 very efficient and effective means by which to determine closest content serving sites 
while keeping load balancer-created traffic at a minimum. 
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